, A TELEVISION PROGRAM RECOMMENDATION SYSTEM 

Field of the Inveation 

The present invention relates to television program selection and more particularly 
to a system for providing recommendations for television program selection. 

Description of Background Art 
Watching television is an everyday activity in a large number of households, and 
provides for a source of entertainment for a range of program content such as sport and 
movies, as well as news and actuality programs (eg. documentaries and lifestyle). 

Traditionally, a viewer would consult a printed television schedule Usting in a local 
newspaper or periodical to find a desirable program to watch, More recently, 
efntertainment program guides have been made available in electronic form via the 
Internet or World Wide Web. However, with the introduction of satellite receivers for 
television and cable television, the number of television channels available to the viewer 
has increased dramatically. This has made the task of selecting a television program to 
watch using either printed program listings or on-screen Electronic Program Guides 
(EPG) very involved and time consuming. 

Program listings that are ordered by characteristics including category, time or 
performers, can assist the viewer in making a selection, but such remains a time 
consuming task. Typically, there may only be a few programs of interest to the viewer 
out of the vast number of available programs. 

Systems are available that monitor those categories of programs a viewer most 
frequently watches and to provide recommendations based on the most frequently 
watched category. Such arrangements suffer &om the disadvantage of simply selecting a 
single program characteristic (such as category) from previously watched programs and 
making recommendations based on this selected program characteristic. However, 
selection by the viewer may depend on various characteristics and even combinations of 
characteristics. Furthemiore. exactly how these characteristics and combinations of 
characteristics are joined for use in making the selection is highly individual for each user 
and prior art systems do not provide this level of flexibility. 

Disclosnre of the Invention 
It is an object of the present invention to substantially overcome, or at least 
ameUorate; one or more disadvantages of existing arrangements. 
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. According to k first aspect of the invention, there is provided a method of 
enabling a selection of a program for viewing in a television system in which title 
information and characteristics of programs are made available as EPG (Electronic 
Program Guide) data including at least one program guide list, the method comprising the 
steps oft 

recording a plurality of characteristics associated with each program viewed by 
said user in the television system; 

forming sets of said characteristics, each said set comprising at least two of said 
characteristics; and 

associating at least each set with an ordered value representative of user's desire 
to view a particular program; 

wherein upon entry of a user request for a program recommendation, performing 
a search of the EPG data for programs with characteristics that best match said sets and 
notifying said user of an availability of programs that best match said sets as program 
reconmiendations. 

According to another aspect of the invention there is provided a recommendation 
system for enabling a selection of a program for viewing in a television system in which 
title information and characteristics of programs arc made available as EPG (Electronic 
Program Guide) data including at least one program guide list, the recommendation 
system comprising: 

memory means for recording a plurality of characteristics associated with each 
program viewed by said user in the television system; 

processing means for forming sets of said characteristics, each said set 
comprising at least two of said characteristics and for associating each said set with an 
ordered value representative of said user's desire to view a particular program; 

searching means for performing a search of the EPG data for programs with 
characteristics that best match said sets; and 

on-screen display means for noting said user of an availability of programs 
that best match said sets as program reconmiendations upon entry of a user request for 
program recommendations. 

According to yet another aspect of the invention there is provided a computer 
program product, having a computer readable medium, having a computer program 
recorded therein, for enabling a selection of a program for viewing in a television system 
in which title information and characteristics of programs are made available as EPG 
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(Electronic Program Guide) data mcluding at least one program guide Ust, the computer 
program product comprising: 

computer program code for recording a plurality of characteristics associated 
with each program viewed by said user in the television system; 

computer program code for forming sets of said characteristics, each said set 
comprising at least two of said characteristics; and 

computer program code for associating at least each set with an ordered value 
representative of user's desire to view a particular program; 

wherein upon entry of a user request for a program recommendation, computer 
program code for performing a search of the EPG data for programs with characteristics 
that best match said sets and notifying said user of an availability of jsrograms that best 
match said sets as program recommendations. 

According to yet another aspect of the invention there is provided a method of 
making recommendations to a user of programs for viewing in a television system 
wherein: 

information regarding programs is made available as EPG (Electronic Program 
Guide) data including at least one program guide list; 

a pluraUty of characteristics associated with each program previously viewed by 
said user, and each of a pluraUty of relationships and corresponding measures of 
acceptance of said user, with respect to program reconmiendations made in response to 
previous program requests, have been recorded; 

said method comprising the steps of; 

forming sets of said characteristics; 

selecting from said relationships at least one relationship, wherem at least one of 
said selected relationships comprises a highest one of said measure of acceptance; 

ordering said sets of characteristics using said selected relationship to produce 
ordered sets of characteristics; 

filtering said ordered sets of characteristics using said selected relationship to 
produce filtered sets of characteristics; 

performing a search of the EPG data for programs with characteristics that best 
match said filtered sets of characteristics, giving preference to highest filtered sets of 
characteristics; and 
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, notifying s^user of an availability of programs that best match said filtered 
sets as program recommendations upon entry of a user request for program 
recommendations. 

According to yet another aspect of the invention there is provided a 
recommendation system for making recommendations to a user of programs for viewing 
in a television system in which information regarding programs is made available as EPG 
(Electronic Program Guide) data including at least one program guide list, the system 
comprising: 

a first memory means for recording a plurality of characteristics associated with 
each program previously viewed by said user, 

a second memory means for recording each of a plurality of relationships and 
corresponding measures of acceptance of said user, with respect to program 
recommendations made in response to previous program requests; 

processing means for forming sets of said characteristics; 

task selection means for selecting fiom said relationships at least one 
relationship, wherein at least one of said selected relationships comprises a highest one of 
said measures of acceptance; 

ordering means for ordering said sets of characteristics using said selected 
relationship to produce ordered sets of characteristics; 

filtering means for filtering said ordered sets of characteristics using said 
selected relationship to prodiice filtered sets of characteristics; 

searching means performing a search of the EPG data for programs with 
characteristics that best match said filtered sets of characteristics, giving preference to 
hi^est filtered sets of characteristics; and 

on-screen display means for notifying said user of an availability of programs 
that best match said filtered sets as program recommendations upon entry of a user 
request for program recommendations. 

According to yet another aspect of the invention there is provided a computer 
program product, having a computer readable medium, having a computer program 
recorded therein, for making recommendations to a user of programs for viewing in a 
television system wherein: 

information regarding programs is made available as EPG (Electronic Program 
Guide) data including at least one program guide list; 
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. a plurality oi characteristics associated with each program previously viewed by 
said user, and each of a plurality of relationships and corresponding measures of 
acceptance of said user, with respect to program recommendations made in response to 
previous program requests, have been recorded; 

said computer program product comprising: 
code for forming sets of said characteristics; 

code for selecting from said relationships at least one relationship, wherein at 
least one of said selected relationships comprises a highest one of said measures of 
acceptance; 

code for ordering said sets of characteristics using said selected relationship to 
produce ordered sets of characteristics; 

code for filtering said ordered sets of characteristics using said selected 
relationship to produce filtered sets of characteristics; 

code for perfonning a search of the EPG data for programs with characteristics 
that best match said filtered sets of characteristics, giving preference to highest filtered 
sets of characteristics; and 

code for notifying said user of an availabiUty of programs that best match said 
filtered sets as program recommendations upon entry of a user request for program 
recommendations. 

Brief Description of the Drawings 

A preferred embodiment of the present invention will now be described with 
reference to the drawings, in which: 

Fig. lA is a schematic representation of a system; 

Fig. IB is a detailed representation of an avatar agent of the system in Fig. lA; 
Fig. 2 is an extract from a typical Electronic Program Guide; 

Fig. 3 is an illustration of an animated character displayed on a display screen of 
the system in Fig. 1 A; 

Fig. 4 is an example of how recommendations may be presented to a viewer by 
the system in Fig, 1 A; 

Fig. 5 is an example of a selection made from the recommendations in Fig. 4; 
Fig. 6 is an example of a viewer profile database; 

Figs 7A to 7K are flow diagrams of a method performed by a learning module of 
the avatar agent illustrated in Fig. 1 A, to learn common features from selections made by 
the viewer; 
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. Fig. 8 IS a fiS^ diagram of a method perfonned by a recommendation module of 
the avatar agent iUustrated in Fig. IB, reasoning to best use the results from the learning 
module to make recommendations of programs to watch to the viewer; 

Figs. 9A to 9F are flow diagrams of an alternative method of reasoning to best 
use the results from the leaming module to make recommendations of programs to watch 
to the viewer; and 

Fig, 10 is a schematic block diagram of a general-purpose computer upon which 
arrangements described can be practiced. 

Detailed Description including Best Mode 
Fig. lA shows a system 50 for automaticaUy suggesting suitable programs to a 
viewer from a large number of available programs. The system 50 comprises a digital 
television (DTV) 10 connected through interconnection 25 to a "set top" box 20. The "set 
top" box 20 is also connected through a gateway 41 to an external network 42. A number 
of content servers 43 and Electronic Program C3mde (EPG) databases 22 are connected to 
the external network 42. The content servers 43 are typicaUy provided by content 
providers and contain multimedia content including movies and television programs. 

The available programs are listed in the EPG databases 22. Each of the content 
providers may maintain an associated EPG database 22. The available programs listed in 
the EPG databases 22 may be linked to the corresponding multimedia content m the 
content setters 43 by means of a program identifier. An extract from a typical EPG 
database 22 is shown in Fig. 2. The EPG database 22 has a number of program entries 
60. each of which may include a number of attributes 61 with values 62. The attributes 
61 may include: 

- EPG ID which is a unique number per entry; 

- Program ID which is unique for each program resulting in re-runs having the same 
Program ID; 

- Category ID. for example '01 ' for art. n6' for drama, '50' for Movies and Series, 
*75' for sport etc.; 

- Subcategory ID. for example, in the movies category '50'. the subcategory '001 ' 
for action/adventure. '064* for comedy, '074' for crime etc; 

- Title; 

- Remarks, which is a general text field about the program entry; 
Keywords; 

Ra.ting; 
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EPG Chmnel; 
Start Day; 
Start Date; 
Start time; 
Duration; and 
Year of Make 
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A DTV-agcnt system 21 is preferably formed within the "set top" box 20. In use, 
the viewer interacts with the DTV-agent system 21 using a remote control device 30. The 
DTV-agent system 21 may altematively be integrated into the DTV 10 or incorporated 
into a personal computer 100 such as that seen in Fig. 10 and appropriately interfaced 
with the DTV 10. 

In the preferred implementation, the DTV-agent system 21 includes a DTV-agent 
36 for controlling the DTV 10, and a number of avatar-agents 37, each avatar-agent 37 
representing a particular viewer. An Inter-agent-server (IAS) 35 manages all inter-agent 
communications and also interfaces with the gateway 41. The DTV-agent system 21 
further includes a number of viewer profile databases 23 accessed by the avatar-agents 
37. The functions ofthe DTV-agent 36 include: 

' the provision of a graphical user interface via a display screen 11 of the DTV 10 

by which recommendations are made to the viewer and to enable the viewer to 

make selections; 

- to control the functionaUty of the DTV 10 including interacting with a television 
tuner module (not illustrated) thereof to select a channel for viewing from the 
plurality of available television channels; and 

- to gather viewer selections and delivers them to the avatar agents 37. 

Each of the avatar-agents 37 is associated with a single viewer and a 
corresponding one of the viewer profile databases 23. As seen in Fig. IB, each avatar- 
agent 37 includes an avatar manager 38 that maintains control of the particular avatar- 
agent 37. The avatar manager 38 accesses the EPG databases 22 through the IAS 35 to 
obtain television program information and the associated viewer profile database 23 to 
build and maintain the viewer profile. The avatar manager 38 is also responsible for 
sending messages to, and receiving messages from, the DTV-agent 36 through the IAS 
35. Within the avatar-agent 37, the avatar manager 38 is also responsible for interfacing 
with each of a learning module 39 and a recommendation module 40. One task of the 
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avatar-agent 37' is fg^build and maintain the viewer prmSe database 23 based on 
selections made by the viewer and processed by the learning module 39. The avatar- 
agent 37 then also uses the viewer profile database 23 to provide recommendations to the 
viewer by processing performed in the recommendation module 40. The 
recommendations are for the most suitable viewing options available for a specific viewer 
and are provided to the viewer via the display screen 1 1 . 

Referring again to Fig lA, the system 50 may fiirther include an EPG agent 44 
that interfaces with both the EPG databases 22 and the IAS 35, The EPG agent 44 
accesses the EPG databases 22 and extract further attributes from the program entries 60, 
which includes Popularity. Urgency and Lifestyle. The Popularity attribute indicates 
whether a program entry 60 corresponds to a (currently) popular event/program, such as 
the Football World Cup or a concert by a popular perfomier The Urgency attribute 
indicates whether a program entry 60 corresponds with an urgent program, such as special 
news/progress reports, weather annoimcements (tornado warnings, etc.), press 
conferences, nation addresses and so on. The Lifestyle attribute indicates that the 
program entry 60 corresponds to a certain type of lifestyle, such as Midday movies, 7pm 
news, or Saturday night music shows. The values of these fiirther attributes are True or 
False. In an alternative implementation, these attributes are already included in the EPG 
databases 22. 

Referring to Tables 1 and 2, examples of typical steps for use of the system 50 
will now be described. 
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TABLE 1 



Step 


Message 


From 


To 


Internal processing 


1 i± 
Irr 








Viewer switches DTV 10 on. 










Animation characters 12 are 










displayed on the display screen 










1 1 , Viewer chooses animation 










character 12. 


3 


S e tAni ma. t i onS e 1 e c t i on 




A A 




4# 


SendUeerData 


AA 


DTVA 




5 








Viewer interactively provides 










personal information and a 










viewing history based on 










prompts displayed on the 










display screen 1 1 . 


6 


SetNewUserData 


DTVA 


AA 


Iw 








Viewer asks for 


o 

o 








recommendations 67. 








Prompt viewer for time and 










date. 


9 


SendRecommendationRequest 


DTVA 


AA 






S e t Re c OTranenda t i ons 


AA 


DTVA 




11 








EPG and preview data 










retrieved. 


12 








Preview data are displayed on 










display screen 1 1 . Viewer 


13 








makes a selection 68. 


SetProgramSelection 


DTVA 


AA 





Note: When the sequence shown in Table 1 reaches a star symbol (*), the DTV- 
agent 36 enters an "idle*' mode, waiting for messages from avatar agent 37. In this mode, 
the DTV 10 displays a television program (on a channel most recently selected by the 
viewer). Sequence points indicated by a hash symbol (#) can be accessed at any time 
(i.e. asynchronously). 



Table 1 illustrates a sequence of events and resulting messages to and from the 
DTV-agent 36 in which: 

1. The user switches the DTV 10 *ON* using the remote control 30. 

2. The viewer needs to identify himself/herself to the DTV-agent system 21. 
Referring to Fig. 3, this may be done by selecting an animation character 12 
from a set of characters generated by the DTV-agent 36 and displayed on the 
display screen 11. The selection may be perfonned using the remote control 
30. In the preferred implementation, there may be three types of characters: 
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(i) ' Un-touched characters, meaning those that are not associated with any 



particular viewer is currently not engaged; and 
(iii) An active character 12, identifying that the associated viewer is presently 
selected. No active character will be present when the DTV 1 0 has just been 
turned ^ON'. 

3. A SetAnimationSelection message is sent to the avatar agents 37, activating 
only the avatar-agent 37 associated with the identified viewer. 

4. A SendUserData message is received from the avatar agent 37, instructing the 
DTV agent 36 to collect viewer data, 

5. The DTV-agent 36 controls the display screen 11 of the DTV 10 for the 
collection of viewer data. The viewer provides the data using the remote control 
30, The first time that a character 12 is selected, the system 50 assimies that it is 
a new viewer using the system 50 and therefore an unregistered viewer. The 
avatar agent 37 has no viewer profile database for the currently unregistered 
viewer. 

The viewer may then be requested by the DTV-agent 36 to select one of a 
number of moods currently being experienced, again by making a selection with 
the remote control 30. Examples of such moods include happy, sad, neutral etc. 
A password may also be requested from the viewer when the program content is 
password'protected (eg, adult content). 

6. The viewer data are formatted and sent in a SetNewUserData message to the 
avatar-agent 37. The DTV agent 36 enters into the idle mode. 

7. The viewer uses the remote control 30 to request fi-om the DTV-agent system 21 
a list of recommended television programs. 

8. The DTV-agent 36 prompts the viewer for a time and date for which 
recommendations should be provided. Alternatively, recommendations may 
automatically be for television programs due to start in the following 
predetermined number of minutes. 

9. The time and date are formatted and sent to the avatar-agent 37 in a 
SendRecommendationRequest message. The DTV agent 36 enters into the idle 
mode. 



viewer; 



(ii) 



Dormant characters, meaning those that are associated with a viewer but that 
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10. 'The ttvatar agdit 37, and in particular the rTOOinmendation module 40, 

determines viewing recommendations for viewing from the EPG databases 22 
that best match the viewer's preferences for the given timeslot and the viewer 
mood. The avatar agent 37 sends these viewing recommendations in a 
5 SetRecommendations message to the DTV agent 36. 

11. Based on the reconunended programs received from the avatar agent 37, data 
are retrieved from the EPG databases 22 and one or more preview databases 
(not shown). The preview databases may form part of the EPG databases 22 or 
alternatively, the content servers 43 and provide a brief example or preview of 

10 the content of a particular program. 

12. The DTV-agent 36 formats the viewing recommendations and displays the 
recommendations on the display screen 11. As illustrated in Fig. 4, the viewing 
recommendations 67 are preferably provided to the viewer on the display screen 
1 1 by displaying a set of previews. Alternatively, a bitmap image or a title only 

□ 15 is displayed on the display screen 11, each of which representing a viewing 
J' recommendation 67. Additional information may also be displayed associated 
Hi with each of the recommendatiorts 67. The viewing reconamendations 67 may 
5 also be displayed in a manner to reflect the program attributes. For example, all 
pi the viewing recommendations 67 having a common category may be displayed 
" ' 20 together. The viewer views the viewing recommendations 67 and selects one of 

□ the viewing recommendations 67 using the remote control 30. The DTV-agent 

Si 36 interacts with the DTV 10, which responds by tuning into a receiver channel 

Py 

Ln on which the selected program is broadcast. The selected program 68 is then 

™ displayed on the full display screen 1 1 as shown in Fig. 5. 

25 13. Infomiation about the selected program 68 is sent to the avatar agent 37 in a 

SetProgramSelection message. The DTV-agent 36 enters its idle mode while 
the selected program 68 is displayed on the display screen 11. 



Table 2 illtistrates a sequence of events and resulting messages to and from the 
30 avatar-agents 37 in which: 

1 . A SetAniraationSelection message is received from the DTV-agent 36 by the avatar- 
agent 37 associated with the selected animation character 12. The other avatar-agents 
37 remain in the idle mode. 
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2. Th, avatar agen>f? detennines whether the selected chl!^ter 12 corresponds to a 
viewer kno^^ to the DTV-agent system 21. or to a new viewer. If the viewer is not 
known to the DTV-agent system 21. the next sequence step is step 3. Otherwise the 
avatar manager 38 enters its idle mode. 

TABLE 2 



Step Message 

1# SetAnimacionSelection 



3 
4 

5 

6 
* 

8 



10 

11 

12 
« 

14 
15 
16 
17 
18 



From To 
dtva aa 



SendViewerData 
SetNewviewerData 



AA 
DTVA 



SendRecommendationRequest DTVA 



DTVA 
AA 



AA. 



SetRecommendatione 
SetProgramSelection 



AA 



DTVA 



DTVA AA 



Internal processing 

Retrieve information from viewer 
profile database 23 to establish 
whether the viewer has profUe data. If 
not, go to step 3. 

Create viewer profile database 23. 
Update viewer profile database 23. 



Retrieve viewer profile and EPG 
information from databases 23 and 22. 
Send viewer data and television 
program information to 

recommendation module 40. 
Recommendation module 40 
constmcts a list of recommended 
television programs 67. 
Receive program recommendations 67 
from recommendation module 40. 



Retrieve viewer profile and program 

data from databases 23 and 22. 

Send viewer data and new program 

data to learning module 39. 

The learning module 39 updates the 

Case-file. 

Receive Case-file fi:om learning 
module 39. 

Update viewer profile database 23 . 



(i.e. asynchronously). ^ ^ accessed at any time 



3. A profile for the new viewer is created in the viewer profile database 23. 

4, A SendViewerData message is sent to the DTV agent 36. 
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5. A SetNcwView^ata message is received from the DW^agent 36. This contains 
static viewer attributes. 

6. The avatar manager 38 stores the viewer attributes in the viewer profile database 23. 
The avatar manager 38 enters its idle mode. 

7. A SendRecommendationRequest message is received from the DTV agent 36. The 
viewer has requested that viewer recommendations 67 for a particular day and time be 
provided. Alternatively, recommendations may automatically be for television 
programs due to start in the following predetermined number of minutes. 

8. The avatar-manager 38 retrieve viewer profile data from viewer profile database 23 
and retrieve television program information fix)m the EPG databases 22. The data is 
formatted for use by recommendation module 40. 

9. The viewer profile data and the program information are sent to the recommendation 
module 40 by the avatar manager 38. Alternatively, the recommendation module 40 
retrieves the data directly. 

10. The recommendation module 40 constructs a list of programs 67 to be recommended 
to the viewer. 

11. The list of recommended programs 67 is sent bom the recommendation module 40 to 
the avatar manager 38. 

12. A SetRecommendations message, containing a list of reconmiended programs 67 is 
sent to the DTV agent 36. The avatar manager 38 enters its idle mode, 

13. A SetProgramSelection is received from the DTV agent 36, indicating that the viewer 
has selected a particular program 68. 

14. The program entry 60 about the selected program 68 is retrieved from the EPG 
database 22. The viewer profile is also retrieved from the viewer profile database 23. 

15. The selected program information is sent to the learning module 39 for updating of a 
Case-file. 

16. The learning module 39 updates the Case-file to take account of the selected program 
68. 

17. The updated Case-file is received by the avatar manager 38 from the learning module 
39. 

18. The updated Case-file is used to update the viewer profile database 23. The avatar 
manager 38 enters its idle mode. 
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■ °P«^-tio^thin me learning n^odule 39 will3. be described in more 

detail. Each program is associated with a number of features (fi). each feature 
representing a muque attribute and attribute value pair. The attributes may include the 
program attributes 61 the EPG database 22 (illustrated in Fig. 2) as weU as viewer 

attributes when the selection was made. The viewer attributes may include for example 
the mood of the viewer. Each attribute has a number of possible values. An example of 
^ attnbute-value pair is Category ^ 'drama' where Category is the attribute and 'drama' 
IS the attribute value. 

Each selection 68 made by the viewer is termed a case (Cj). and is defined by a set 
of features (fi). For example, a case may be (Category = 'drama'. Sub-category = 
comedynirama'. .... EPG channel = 'Nhk'. .,.). The cases (Cj) may have different 
number of features (fi). dependent on the infonnation available. All cases are stored in 
the viewer profile database 23 in a case file for use by the learning module 39. 

The learning module 39 operates to identify shared or generalisation patterns of 
features (fi) fi-om a number of cases (Cj) from the case file. The learning module 39 takes 
the case file as input and generates a Generalisation Pattern List (GPList). stored also in 
the viewer profile database 23. The GPlist contains all generalisation patterns from dae 
case file. Each generalisation pattern in the GPList may be represented as follows: 
([intersection], occurrence), 
wherein intersection Indicates a set of the features (fi) that are shared by different 

cases (Cj). Occurrence indicates the number of cases that share such an intersection. For 
example, ftom the following cases: 

CI = (fl, f2, G, f4. f7); 

C2 = (fl, f2. f5, f6, f7); and 

C3=(f3, f5,f5. f8) 

the GPList generated from the three cases has three items: 
([fl. £2, f7], 2); 
([G], 2); and 
([f5. f6], 2) 

The first GPList entry above arises &om the features fl, f2 and f7 occurring both 
m cases Cl and C2. The other entries are derived in a similar manner. 

Each time new cases (Cj) become available through selecfions by the viewer of 
programs to watch, those new cases ar« added to the case file and a new GPList is 
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louowmg three cases: 

Cl = (Category = -drama'. Sub-categoo' - 'con«dy-dn«u|.^G ckannel = 'Nhk')- 

C3 = (Caregory = 'sp^; ePG channel = • WoW, StanTime ='S:iy,Day= 'Sat') 
The GPList generated by the learning module would only include: 
([Category = 'drama', £PG channel « 'Nhk'], 2) 

When new viewer selections 68, and therefore further cases, became available, for 
example 

C4 = (Category » 'drama', Sub-categary = Talk'. EPG channel = 'Nhk')- and 
C5 - (Category = 'specs', Subcategory = 'Current affiun'. startn^e = •io:00- £>«y = '^at') 
cases C4 and C5 are added to the case file and the GPList is recalculated by the 
leanung module 39 to contain the following entries: 
([Catego?y = 'drama'. EPG channel = 'Nhk']. 3) 
(.[Category = 'sports*. Day = 'Sat']. 2) 

A procedure MAIN for performing the core function in the learning module 39 is 
shown m Fig, 7 A. Three data structures are used in the procedure namely, the Case-file 
which contains a number of cases (Cj), the GPList which keeps all generalisation patterns 
and an Examined-case-list which contains cases that ai« already processed. InitiaUy 
upon initiation of the procedure MAIN when a viewer requested for recommendations' 
the GPList and the Examined-case-list are empty. 

The procedure MAIN starts in step 200 by finrt obtaining a hst of new cases m 
step 201 and the Case-file from the viewer profile database in step 202. A sub-routine 
UPDATE-CASE-FILE is called in step 203 for updating the Case-file by adding the new 
cases. The sub-routine UPDATE-CASE-FILE starts at step 212 in Fig. 7B. 

Intersections for each case of the Case-file with the current GPList is obtained in 
the remaimng steps 204 to 21 1. A first entry from the Case-file is taken m step 204 and 
used as an input case when calhng sub-routine GEN^TASE-GPList in step 205 Sub- 
routine GEN-CASE^PList finds the genex^ization patterns between the input-case and 
Items m the GPList and starts at step 220 in Fig. 7C. Sub-routing GEN-CASE- 
EXAMINED-CASES is called in step 206 for finding generalization patterns between 
the mput-case and the cases in the Examined-case-Ust. Sub-routing GENKTASE- 
EXAMINED^ASES starts at step 310 in Fig. 7H. m step 207, the input-case is added 
to the Examined-case-hst. Cases (Cj) are therefore progressively moved from the Case- 



519533US.doc 



15 



16 

file to the Exaniiiied^case-list until the Case-file is empty. St^^ 208 determines whether 
Case-file has any more entries. If there are any remaining entries in the Case-file, the 
procedure MAIN proceeds to step 209 where the next entry fi-om Case-file is used as 
input-case and the procedure MAIN continues to step 205. 

After step 208 determines that the Case-file is empty, the procedure MAIN 
produce generalization patterns in the GPList as an output in step 210 and ends in step 
2J 

/yj%\ y Referring now to Fig. 7B wherein the sub-routine UPDATE-CASE-FILE is 
own. This sub-routine includes the new cases produced as input in step 201 in 
AIN and into them into the current Case-file. It receives the entries fi-om the 
list of new c^es in step 213 and taking a next new case from the list of new cases in step 
214, the nextXnew case is added onto the end of the Case-file. Step 216 determines 
whether all the cases has been dealt with and proceeds to steps 217 and 215 where 
the next entry is ^ded to the Case-file. An updated Case-file is produced as output in 
step 219 and the sub-routine UPDATE-CASE-FILE ends in step 219. 

Referring to Fig. 7C , the sub-routine GEN-CASE-GPLIST is to find all 
generalization patterns between the input-case and all items in the GPList. It further 
updates the GPList with all new generalization patterns between the input-case and the 
current GPList. 

20 GEN-CASE-GPLIST starts in step 220 and receives the input case and the 

current GPList as inputs in step 221. It is determined in step 222 whether the current 
GPList is still empty. If the current GPList is empty, then no generalization patterns 
between the input-case and the GPList can exist and the sub-routine returns m step 236. 

With items in tiie GPList, the sub-routine continues to step 223 wherein all 

25 generalization patterns between the input-case and all items in the GPList are found by 
calling sub-routine G_List_GEN. The generalization patterns are put in a GPList, which 
contains potential generalization patterns between the input-case and the GPList. The 
subroutine G_List_GEN starts at step 240 in Fig, 7D. 

It is determined in step 224 whether the G_List is empty. If the G_List is empty, 

30 then no generalization patterns between the input-case and the GPList was found by sub- 
routine G_List_GEN and the sub-routine GEN-CASE-GPLIST retumiS in step 236. 

With items in the G_List, the sub-routine GEN-CASE-GPLIST continues to step 
225 where subroutine UG_Llst_GEN is called. Subroutine UG_List_GEN starts at step 
260 in Fig. 7E, and forms a imique generalisation pattem list, UG_List, firom the G_List. 
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A first item from the UG_List, UG_Item, is retrieved and the intersection, 
First_Intersectioa, from the UG_Item is extracted in step 226. A first item from the 
GPList, GPList_Item, is retrieved and the intersection. Second_InteTsection, from the 
GPListJtem is extracted in step 227. 

Step 228 calls sub-routine INT_MATCH to determine whether First_Inter5ection 
and Second_Intersection match. Sub-routine INT_MATCH starts at step 280 in Fig. 7F. 
If step 228 finds that First_Intersection and Second_Intersection match, the occurrence of 
GFList_Item is made equal to that of UG_Item in step 229. The sub-routine continues to 
step 233. 

If step 228 finds that First_Intersection and Second_Intersection do not match, 
then step 230 determines whether all items of the GPList have been considered. If items 
remain, the next item in the GPList is retrieved with it's intersection as 
Second_Intersection in step 231, before step 228 again determines whether 
First_Intersection and Second_Intersection match. If step 230 determined that all items in 
the GPList have been considered, then the UG_Item is added to the GPList in step 232 
and the sub-routine continues to step 233, 

If step 233 detemiines that all items in the UG_List have not been considered, 
then the next item in the UG_List is retrieved with it's intersection as First_Intersection in 
step 234 and followed by step 227. Alternatively, if step 233 determines that all items in 
the UG_List have been considered, the sub-routine GEN-CASE-GPLIST outputs the 
GPList in step 235 and returns in step 236. 

Referring to Fig. 7D, sub-routine G_List_GEN is described, which determines all 
generalisation patterns between the input-case with all items in the GPList. Starting at 
step 240 , it receives as inputs the input^ase and the GPList. The inputs are obtained in 
step 241, A first generalisation pattern, GPList_Item is obtained from the GPList in step 
242, a first feature firom the input case is retrieved in step 243 and a first feature from the 
intersection part of the GPList_Itcm is retrieved in step 244. Step 245 detemiines 
whether the retrieved feature frx>m the input-case is the same as the retrieved feature from 
the GPList_Item. If no match is found in step 245, step 246 determines whether all 
features from the GPList__Itcm has been dealt with. With more features in the 
GPList_Item remaining, step 255 retrieves a next feature from the GPListJtem and 
continues to step 245. If all the features in the GPList_Item were considered, the sub- 
routine continues to step 247. 
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■If step 245^onds in the affinnative, step 252^enmnes whether a new 
generalization pattern has been created and create one in step 253 if r^uired, or if it was 
already done, proceeds to step 254. where the shax^ feature is added to the new 
generalization pattern. The sub-routine continues to step 247 where it is detennined 
whether all features fiom the input-case have been dealt with. If there a« remaining 
features m the input-case, step 256 retrieves the next feature from the input-case 

If step 247 determined that all the features from the input-case were considered 
step 248 detennines whether a new generalisation pattern was created in step 252 If thJ 
generalisation pattern already existed in the intersection parts of the GPList, the sub 
routme continues to step 24^ where the occurrence of the new generalisation pattern is 
given a value of the GPList Item that has the same intersection plus 1. In step 250 the 
new generalisation pattern is added to the G.List. 

r^!'.''''' ^'^^ determined that the new generalisation pattem does not already exist in 
the GPList, then the sub-routine continues to step 251. 

Step 251 determines whether all items from the GPList have been considered If 
an Item remains in the GPList. the sub-routine continues to step 257 wher« the next item 
m the GPUst is retrieved and step 243 is executed. Alternatively, with all items in the 
GPList considered, the sub-routine G_List_GEN returns in step 259 after producing the 
new G_List as output in step 258. 

Referring to Fig. 7E, a sub-routine UG_List_GEN is shown that procedure forms 
a umque generalisation pattern list. UG.List. Starting in step 260. the sub-routine 
receives in step 261 the GPList as input. In step 262 the first generalisation pattern is 
copied from the G.List into the UG.List. A first item from the G_List, G Lis. Item, is 
refrieved and the intersection, Fin^t.Intersection, from the G_List_Item is reieve'd in step 
263. A fxxst item from the UGList. UGList.Item. is retrieved and the intersection, 
Second.Mtersection, from the UGList_Item is retrieved in step 264. 

Step 265 calls sub-routine INT.MATCH to determine whether First.Intersection 
and Second.lntersection match. Sub-routine INT.MATCH starts at step 280 in Fig 7F 
If Forst.mtei^ection and Second.Intersection match, the higher occurrence of the two 
.t«ns. G.List.Item and UG.List.Item. is determined and saved as the occurrence of 
UG_List_Item in steps 269 and 270. TTie sub-routine continues to step 268. 

If Fiist.Intersection and Second_Intersection do not match, step 266 detemunes 
whether all items of the UG.List have been considered. If items remain, the next item in 
the UG.List is retrieved with its intersection as Second.Intersection in step 271, before 
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step 265 kgain deteimines whether First_Intersection and Second_Intersection match. If 
step 266 determined that all items in the UG.List have been considered, then the 
G_List_Item is added to the UG.List in step 267 and the sub-routine continues to step 



268 



\ ^ determines that all items in the G_List have not been considered, then 
fjjK^next W in the G,List is retrieved with it's intersection as Fiist_Intersection in step 
263 and foWed by step 264. Alternatively, if step 268 deteraiines that all items in the 
G_List have Wn considered, the sub-routine UG_LIST_GEN outputs the UG.List in 
step 273 and reWns in step 274. 
> RefeiTing to Fig. 7F. subroutine INT_MATCH is shown which check whether the 

First_Intersection and the Second_Intersection, obtained as inputs in^step 281, are the 
same. Step 282 retrieves the first feature from First_Intersection, named First-feamre, 
followed by step 283 where the first feature from Second_Inteisection, named Second- 
feature, is retrieved. Step 284 calls sub-routine FEATURE-SAME to detemiine whether 
First-feature is the same as Second-feature. Sub-routine FEATURE-SAME starts at step 
300 in Fig. 7G. If they are the same, dien step 285 detemiines whether all the features of 
First_Intersection have been considered. If this is affirmative, then the sub-routine 
continues to step 286. If not. then step 296 retrieves the next feature from 
First_Intersection, names it First-feature and continues to step 283. However, if step 284 
determined that First-feature is not the same as Second-feature, then step 290 detemines 
whether all the features of the Second_Intersection have been considered. If this is 
affirmative, then the sub-routine INT_MATCH returns a "NO" in step 292. If features 
of the Second_Intersection remain, then step 291 retrieves the next feature from 
Second_Intersection, names it Second-feattire and continues to step 284. 

Step 286 retrieves the first feature from Second_Intereection, named Second- 
feature, foUowed by step 287 where the first feature fiwm First_Intersection, named First- 
feature, is retrieved. Step 288 calls sub-routine FEATURE-SAME to determine whether 
First-feature is the same as Second-feature. If they are the same, then step 289 detcnnines 
whether all the features of Second_Intersection have been considered. If this is 
affirmative, then the sub-routine INT_MATCH returns a "YES" in step 298. If not, then 
step 297 retrieves the next feature from Sccond_Intersection, names it Second-feature and 
continues to step 287. However, if step 288 determined that First-feature is not the same 
as Second-feature, then step 293 determines whether all the features of the 
First_Intersection have been considered. If this is affiimative. then the sub-routine 
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n^_m.TCH retu^-w in step 295. If featu«s of thft st.Intersection remain, 
then step 294 retrieves the next feature from First_Intersection. names it First-feature and 
continues to step 288. 

Referring now to Fig. 7G. sub-routine FEATURE-SAME is described, which 
checks Whether two given features are the same. Therefore, in step 301 it receives as 
mputs. Fir^t-feature and Second-feature. Step 302 gets the attribute of Fim-feature 
named First-f-attribute. and step 303 gets the attribute of Second-feature, named Second- 
f-attnbute. Step 304 gets the value of First-feature, named First-f-value, and step 305 gets 
the value of Second-feature, named Second-f-value. 

Step 306 determines whether First-f-attribute is the same as Second-f-attribute 
and step 307 determines whether First-f-value is the same as Second-f- value, If the' 
answers of both steps 306 and 307 ax^ affirmative, then sub-routine FEATURE-SAME 
returns a ''YES" in step 309. If any one of the answers of steps 306 and 307 is negative 
then sub-routine FEATURE-SAME returns a ♦'NO" in step 308. 

Sub-routine CTN-CASE-EXAMINED-CASES starts in step 310 in Fig. 7H 
This sub-routine finds generaUsation patterns between the input-case from Case-file and 
cases in the Examined-case-Ust. which it receives as inputs in step 311. Step 312 
determines whether the Examined-case-Ust is empty and returns in step 313 if this is 
afSfinnative. IF the Examined-case-Ust has items, the sub-routine continues to step 314 
where the first case from the Examined-case-Ust is retrieved. Step 315 calls subroutine 
GET.GEN-PATTERN to calculate a generaUsation pattern. Gen-pattem, between the 
input-case and the case firom the Examined-case-Ust. Subroutine GET-GEN-PATTERN 
starts at step 330 in Fig. 71. 

Step 316 determines whether a Gen-pattem has been found. If a Gen-pattcm has 
been found, the sub-routine determines in step 317 whether the Gen-pattem match any 
Item m the GPList by calling sub-routine IF-MATCH. Sub-routine IF-MATCH starts at 
step 350 in Fig. 7J. If the Gen-pattem does not match any item in the GPList. then step 

318 adds Gen-pattem to GPList as a new item and continues to step 319. If step 317 find 
that the Gen-pattem match an item in the GPList, then the sub-routine continues to step 

319 where it is determined whether all cases in the Examined^ase-Ust have been 
considered. 

If step 319 detemiines that cases in the Examined-case-Ust remain to been 
considered, then step 320 retrieves the next case from the Examined-case-Ust and 



519533US.doc 



continues to step Sl^T^Altematively. step 321 outputs the ^ist and the sub-routine 
GEN-CASE-EXAMINED-CASES returns in step 322. 

Referring to Fig. 71, wherein sub-routine GET-GEN-PATTERN for identifying a 
generalization pattern. Gen-pattern, between an input-case from the Case-file and one 
5 case from the Examined-case-list, is shown. The sub-routine starts in step 330 by 
obtaining input-case and a case from the Examined-case-Ust as inputs in step 331. It takes 
these two cases as input and compares their features. If some features are shared by the 
two cases, then these shared features will be included in the intersection part of Gen- 
pattem. The occurrence in Gen-pattem will be 2. Otherwise, if no features are shared 
10 between the cases, an empty Gen-pattem will be produced as output. 

Step 332 retrieves the first feature from the input-case, named First-feature, 
followed by step 333 where the first feamre from the case from the Examined-case-Iist! 
named Second-feature, is retrieved. Step 334 calls sub-routine FEATURE-SAME to 
determine whether First-feature is the same as Second-feature. Sub-routine FEATURE- 
p u SAME starts at step300 in Fig. 7G. If they are the same, then step 335 would keep this 

I feature in the intersection part of Gen-pattem and proceeds to step 338. If step 334 

p determined that the features were not the same, then step 336 determines whether aU the 

I features of the case from the Examined-case-list have been considered. If this is 

j afifiimative. then the sub-routine continues to step 338. If not, then step 337 retrieves the 

yi 20 next feature of the case from the Examined-case-hst. names it Second-feature and 

B continues to step 334. Step 338 deteimines whether all features of the input-case have 

J been considered. If this is affirmative, then the sub-routine continues to step 340. 

\^ However, if step 338 determined that all the features of the input-case have not been 

I considered, then step 339 rfetrieves the next feature of the input-case, names it First- 

~ 2 5 feature a nd continues to step 333. 

4 f^""^^ 340 detennines whether the Gen-pattem is empty. If the Gen-pattem is not 
y ^pty, th^the occuirence of Gen-pattem is made 2 and the subroutine GET^EN- 
PATTERN>^ttims in step 343 after producing as output Gen-pattem in step 342. If step 
340 determine^at Gen-pattem is empty, the sub-routine GET-GEN-PATTERN also 

30 returns in step 34\. 

Referring to Fig. 7J. sub-routine IF-MATCH is shown. This sub-routine is to 
check whether the intersection of the generalisation pattern of Gen-pattem matches the 
intersection of GPList. The sub-routine starts in step 350 and accepts Gen-pattem and 
GPList as inputs in step 351. 
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Step 3 '52- e^Kcts the intersection part of Gen^ftem and name it Gen- 
intersection. Step 353 retrieves the first item from GPList and the intersection part of this 
item is extracted and named GP-intersection in step 354. 

Step 355 calls sub-routine IF-SAME, which starts at step 370 in Fig. 7K, to 
determine whether Gen-intersection and GP-intersection are the same. If a match is 
found, then the sub-routine IF-MATCH returns a "YES" in step 359. If a match was not 
found in step 355. then step 356 determines whether all the items of GPList have been 
considered. If this is affiimative, then the sub-routine IF-MATCH returns a "NO" in 
step 360. However, If step 356 determines that there are items of GPList that were not 
yet considered, then step 357 retrieves the next item from the GPList, step 358 extracts 
the intersection part of the item and name it GP-intersection and the sub-routine continues 
to step 355. 

.efening to Fig. 7K, subroutine IF-SAME is shown which check whether Gen- 
Ltersectibn and GP-intersection, obtained as inputs in step 371, are the same. Step 372 
retrieves the first feature from Gen-intersection, named First-feature, followed by step 
373 where Vhe firet feature from GP-intersection, named Second-feature, is retrieved. 
Step 374 calls sub-routine FEATURE-SAME to determine whether First-feature is the 
same as Secoiid-feature. Sub-routine FEATURE-SAME starts at step300 in Fig. 7G. If 
they are the sari*, then step 378 determines whether all the features of Gen-intersection 
have been consid^ed. If this is affinnative, then the sub-routine continues to step 379. If 
not, then step 388 ^tneves flie next feature from Gen-intersection, names it First-feature 
and continues to ste^373. However, if step 374 determined that First-feature is not the 
same as Second-feature, then step 375 determines whether all the features of the GP- 
intersection have been c^sidered. If this is affinnative. then the sub-routine IF-SAME 
returns a "NO" in step 2^. If features of the GP-intersection remain, then step 376 
retrieves the next feature frd^ GP-intersection, names it Second-feature and continues to 
step 374. 

Step 379 retrieves the first feature Gmm GP-intersection, named First-feature, 
followed by step 380 where the first feature from Gen-intersection, named Second- 
feature, is retrieved. Step 381 calls sub-routine FEATURE-SAME to determme whether 
First-feature is the same as Second-feature. If they are the same, then stqp 385 determines 
whether all the features of GP-intersection have been considered. If this is affirmative, 
then the sub-routine IF-SAME returns a "YES" in step 386. If not, then step 387 
retrieves the next feature from GP-intersection, names it First-feature and continues to 
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r, iTstep 381 detennined that First- feature i?^r 



step 380/ However, iTstep 381 detennined that First-feature i^not the same as Second- 
feature, then step 382 determines whether all the features of the Gen-intersection have 
been considered. If this is affirmative, then the sub-routine IF-SAME returns a **NO" in 
step 384. If features of the Gen-intersection remain, then step 383 retrieves the next 
feature from Gen-intersection, names it Second-feature and continues to step 381. 

In Fig. 6, an example of a viewer profile 500 for a particular viewer is shown. 
The Viewer profile 500 may correspond to the GPList determined by method shown in 
Figs. 7A to 7K, performed by the learning module 39 of the avatar agent 37 associated 
with the particular viewer, with the GPList having the following intersections and 
occurrence values: 

([Category = 'drama'], 6) 

([Category = 'drama'. Sub-category = 'social', Year_pfjnake = '1999*]. 3) 

([Category = *drama', Sub-category = *sociar. Start JTime = '2200', Year_of_make 
= *1999*].2) 

{[Sub-category = 'social'], 8) 

([Sub-category = 'social'. Day = *Thu'], 2) 

([Category^ 'movie'], 10) 

([Sub-category = 'social', Day = *Mon'], 2) 

([Category = 'movie', Sub-category = 'social*], 5) 

([Sub-category = 'social'. Day = 'Wed'], 2) 
The columns 501 in Fig. 6 represent the attributes of the intersections and the 
entries represent the values 502 of the attributes. Each row 503 in the viewer profile 500 
represents an item in the viewer profile 500. Each item 503 in the viewer profile 500 also 
has a Date_Stamp entry. In the preferred implementation, the Date_Stamp value of the 
item 503 is the date of the most recent viewer program selection 68 that contributed to the 
intersections in the item 503, Alternatively, the Date_Stamp value may be the average of 
the dates of all viewer program selections 68 that contributed to the intersections in the 
item 503. For example, the item 503 in the third row has the following values and 
interpretation: 
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Attribute 



.ttrib ate-value 



Interpretation 



Category_ID 



Category = 'drama' 



Subcategory_ID 



Sub-category = 'social' 



Start Time 



2200 



Startjnme = '2200' 



Day 



Don't care 



EPG channel 



Don't care 



Year of Make 



1999 



Year_of_make='\999' 



The occuirence of this intersection is 2 and the last time the viewer made a 
program selection 68 that contributed to this intersection was 24 April 1999. All entries 
with are interpreted as **Don't care**. 

Operations within the recotnmendation module 40 will now be described in more 
detail. The recommendation module 40, according to the preferred implementation, uses 
a number of tasks to compile the list of viewer recommendations 67. Various tasks are 
defined, with each task defining a unique combination of a manner of ordering the viewer 
profile 500, and particular Relevance Filters for filtering the ordered viewer profile. 

The first aspect of each of the tasks, in accordance with the present 
implementation, is the manner in which the viewer profile 500 is ordered. The ordering 
arrangements may include: 

• WeightFactor Ordenng arranges the viewer profile entries 503 by descending 
occuirence value, ie. feature (fi) intersections occurring most fi-equently take 
precedence. 

• Specificity Ordering arranges the viewer profile entries 503 by descending 
specificity level, ie. entries 503 which specify more program attribute-value pairs 
than others take precedence. 

• Generality Ordering arranges the viewer profile entries 503 by ascending 
specificity level, ie. entries 503 which specijfy less program attribute- value pairs 
that others take precedence. 

• Recency Ordering arranges the viewer profile entries 503 by descending 
Date Stamp, ie. most recent entries 503 take precedence. 
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• 'WeightBlecericy Ordering arranges the viewer profile entries 503 by descending 
occurrence value, while preferring entries 503 having most recent Date_Stainp 
values when occxirrence values are the same, 

• Specificity Weight Ordering arranges the viewer profile entries 503 by 
descending specificity level, while preferring entries 503 having higher 
occurrence values when specificity levels are the same. 

• Generality Weight Ordering arranges the viewer profile entries 503 by 
ascending specificity level, while preferring entries 503 having higher occurrence 
values when specificity levels are the same. 

• Recency Specificity Ordering arranges the viewer profile entries 503 by 
descending Date_Stamp, while preferring more specific entries 503 when 
Date_Stamp values are the same. 

The following possible orderings may be useful: 

• Specificity Recency Ordering arranges the viewer profile entries 503 by 
descending specificity level, while preferring most recent entries 503 when 
specificity levels of entries are the same. 

• Generality Recency Ordering arranges the viewer profile entries 503 by 
ascending specificity level, while preferring most recent entries 503 when 
specificity levels of entries are the same. 

The second aspect of each of the tasks, in accordance with the present 
implementation, is the particular Relevance Filters applied to the ordered viewer profile, 
which includes: 

• TimeSlot Filter verifies whether a viewer profile entry 503 is time- or day- 
specific and verifies the specific time and/or day with the day and time for which 
reconmxendations are requested. 

Condition to reject Viewer profile entries 503: Start_Time is specified in the 
viewer profile entry 503, but is not equal to the time for which reconmiendations 
are requested or Day is specified in the viewer profile entry 503, but is not equal 
to the day for which recommendations are requested. The TimeSlot Filter is 
included in all filter operations. 
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• WeightFactor Filter verifies whether a viewer profile entry 503 has an 
occurrence value that is higher than a current average occurrence value of all the 
viewer profile entries 503. 

Condition to reject Viewer profile entries 503: Occiurence value <= average 
occurrence value. 

• Popularity Filter verifies whether a viewer profile entry 503 corresponds to a 
(currently) popular event/program, eg. Football World Cup, Celine Dion concen. 
Condition to reject viewer profile entries 503: When the POPULARITY value is 
false, 

• Urgency Filter verifies whether a viewer profile entry 503 may be met by an 
urgent program, eg. special news/progress reports, weather announcements 
(tomado warnings, etc), press conferences, nation addresses and so on. 
Condition to reject viewer profile entries 503: When the URGENCY value is 
false, 

• Lifestyle Filter verifies whether a viewer profile entry 503 corresponds to a 
(knovm) type of a lifestyle, eg,, Midday movies, 7pm news, or Saturday night 
music shows. 

Condition to reject Viewer profile entries 503: When the LIFESTYLE value is 
false. 

By combining filter characteristics together, other filters can be obtained. For 
example, 

• PopularLifeStyle Filter verifies whether a viewer profile entry 503 corresponds 
to a (known) type of a lifestyle and (currently) popular event/program, eg., Celine 
Dion concert on Saturday night. 

Such combinations are significantly restrictive, and a task filtering ordered viewer 
profile entries with a combined filter may reject most if not all viewer profile entries 503, 
Therefore, it is expected that only a small proportion of viewers (most demanding ones) 
may value a task that includes such a filter. 

Certain of the tasks provide reconmiendations due to more established Viewer 
profile entries 503 (gradual change), whereas other tasks attempt to produce viewer 
recommendations based on a sudden change in the viewer's viewing habits. 
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OS of both the first (ordering) and second (filtering) aspects of 
the tasks, a number of usefiji tasks may be defined including! 
Gradual Change Tasks 

Basic Task Weight Factor Ordering + TimeSlot Filter 

(broad-minded viewer) 
DieHard Task = Specificity Weight Ordering + WeightFactor Filter 

(old habits die hard) 
OldFavourites Task = Generality Weight Ordering -h WeightFactor Filter 

(original recipe) 

BestPick Task = Specificity Weight Ordering + Popularity Filter 

(choosy viewer) 

Prime Time Task = Weight Recency Ordering + LifeStyle Filter 

(my TV - my castle) 

Sudden Change Tasks 

HotTopic Task = Recency Specificity Ordering + Popularity Filter 

(sudden change due to popularity change) 
NewLife Task « Recency Specificity Ordering + LifeStyle Filter 

(sudden change due to life style change) 
WatchDog Task = Recency Specificity Ordering + Urgency Filter 

(sudden change due to crisis situation). 
Because different viewers may be satisfied with viewer recotnmendations 
produced as a result of the execution of different tasks^ each task has an associated viewer 
specific Task__Value, indicating the particular viewer's satisfaction with the viewer 
recommendations 67 provided by the particular task. The Task_Value is also stored in 
the viewer profile database 23 and each task, represented by a \mique Task_ID, may be 
stored as follows; 



Task_ID 


Number 


Task_Value 


Number 


Task_Type 


gradual or sudden change 



Generally, an optimal set of viewer reconmiendations 67 is obtained as a result of 
a balance between various tasks. In the preferred implementation, a combination of 
gradual change tasks and sudden change tasks is used to compile the viewer 
recommendations 67. 
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Refemng to Fig^when the recommendation module iS^T instructed by the avatar 
manager 38 to provide television program recommendations, the procedure 
RECOMMEND is started in step 801. As inputs the procedure RECOMMEND 
receives: 

• The Viewer profile 500 from the viewer profile database 23, which includes viewer 
profile entries 503. Each viewer profile entry 503 includes the intersecting features 
and the occurrence count; 

• A list of program entries and their features (fi) from which to select viewer 
recommendations 67. This Ust was retrieved by the avatar manager 38 based on the 
time/date combination provided by the viewer for which viewer recommendations are 
required; and 

• a predetermined maximum number of recommended programs; 

Initially the list of viewer recommendations is empty. If it is determined in step 802 
that all the viewer profile entries 503 have been examined or that there are already the 
predetermined maximum number of viewer recommendations or that the list of program 
entries is empty, then the procedure continues to step 805 where the Ust of viewer 
recommendations are passed to the avatar manager 38. Otherwise, the procedure would 
continue to step 803, wherein a next viewer profile entry 503 is selected according to a 
selection criterion. The selection criterion may be one of the following: 

• Choose the next viewer profile entry 503 with the lowest occuirence. (i.e. start from a 
more spiecific match). 

• Choose the next viewer profile entry 503 with the highest occurrence (i.e. start from 
the most general match) 

• Choose the next viewer profile entry 503 with the greatest number of features in the 
intersection (i.e. the most specific match) 

In step 804, all program entries 60 in the list of program entries whose features (fi) 
includes those in the viewer profile entry 503 chosen in step 803, are moved fi-om the list 
of program entries to the Ust of viewer recommendations. The procedure goes back to 
step 802. 

Referring to Fig. 9A where an alternative procedure for providing television 
program recommendations is shown. Procedure RECOMMEND is started in step 601. 
In step 602 the procedure RECOMMEND receives as inputs: 
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The Viewer profile 500 from the viewer pn>file database 23, which includes 
viewer profile entries 503. Each viewer proSle entry 503 includes the intersecting 
features, the Date_Stamp and the occurrence count; 

• The viewer specific Task_VaIues; 

• A list of program entries and their features (fi). retrieved from the EPG 
databases 22; and 

• A predetermined desired number of recommended programs R. 

In step 603 a counter / is set to a value of 1. A variable K is also set. where K 
represents the number of tasks used by the recommendahon module to provide viewer 
recommendations 67. m the px^fe^ed implementation, the gradual change task having a 
maximum Task.Value and all the sudden change tasks are used. Hence, the variable K is 
set as the number of sudden change tasks plus 1. 

This is followed by step 604 where a task, identified by its Task.ID. is chosen 
With the counter / equal to 1. step 604 chooses the gradual change task with a maximum 
Task_Value. If the compter /is larger than 1. the next sudden change task is chosen. 

Step 605 sets a variable a;. The variable a, represents the desired portion of 
viewer recommendations that the recommendation module 40 would determine that 
would be made up from the task chosen in step 604. Accordingly, the variable a, is set as 
l/(2n). with n being 1 or K-1 for gradual and sudden change tasks respectively 

Step 606 calls sub^routine REASON for applying the chosen task and for 
producmg viewer recommendations 67. Sub-routine REASON starts at step 650 in Fig, 

step 607 determine whether the REASON sub-routine has produced at least 1 
recommendation for the chosen task. If the REASON sub-routine was unable to produce 
the at least 1 reconmiendation. then the intersecting features of the viewer profile entry 
503 are relaxed in step 609. In the preferred implementation, all intersections are ignored 
except for category and sub-category. if they exist as intersections. The procedure 
RECOMMEND returns to step 606 where the sub-routine REASON is caUed again with 
the relaxed features. 

If step 608 determines that the features of the viewer profile entry 503 were 
already relaxed, then the procedure RECOMMEND continues to step 621 . 

If step 607 determines that the REASON sub-routine was able to produce at least 
one recommendation for the chosen task, then step 621 determines whether the counter / 
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is still smaller than variable K, If the counter / has a value ofK, then recommendations 
for the desired tasks have been produced and the procedure RECOMMEND continues to 
step 623 where the SetReconunendations message^ containing a list of recommended 
programs, is passed to the avatar manager 38, fiom where it is sent to the DTV agent 36. 
Alternatively, the recommendation module 40 may send the Set-Recommendat ions 
message directly to the DTV agent 36. 

However, if step 621 determines that the counter 1 is smaller than variable K, then 
viewer recommendations for certain tasks must still be produced. Therefore, step 622 
increments the counter / and the procedure RECOMMENB returns to step 604 for 
determining viewer recommendations for a next task. 

Referring to Fig. 9B wherein the sub-routine REASON for applying the chosen 
task and for producing viewer recommendations is shown. Sub-routine REASON starts 
in step 650. 

Step 652 orders the viewer profile entries 503 by applying the ordering aspect of 
the task selected in step 604 of the RECOMMEND procedure. For example, if the 
gradual change task DieHard task was selected, then the viewer profile entries 503 are 
ordered by the Specificity Weight Ordering which arranges the viewer profile entries 503 
by descending specificity level, while preferring entries 503 having higher occurrence 
values when specificity levels are the same. Step 653 identifies the filter, specified by 
chosen task. For example, with the DieHard task, step 653 identifies the filter 
WeightFactor Filter, which verifies whether a viewer profile entry 503 has an occurrence 
value that is higher than a current average occurrence value of all the viewer profile 
entries 503. 

Step 655 sets a viewer profile entry counter J to a value of 1 and a 
recommendations coimter r to a value of 0. In step 657 it is detemiined whether the y-th 
ordered viewer profile entry 503 satisfies the chosen filter fi-om step 653. It is again noted 
that the TimeSlot Filter is always included in all filter operations whereby all viewer 
profile entries 503 with specific Start_Time, Start_Day or Start_Date (ie not equal to - 1: 
don't care), and where the specific Start Time Start_Day or Start_Date is not equal to the 
current time, current day or current date respectively, are removed. 

If step 657 detemiines that the y-th ordered viewer profile entry 503 does not 
satisfy the chosen filter, then the sub-routine REASON continues to step 677 for 
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• determining whethMle viewer profile countery is still smaJISr than the total number of 
\'iewer profile entries 503, N. 

Alternatively, if step 657 determines that they-th ordered viewer profile entry 503 
does satisfy the chosen filter, then the sub-routine REASON continues to step 660 where 
a dymanic nile is build as EPG database filter by calling sub-routine 
BUILD_DYNAMIC_RULE. The sub-routine BUILD.DYNAMIC.RULE is shown m 
Fig. 9C and starts in step 700. 

Step 662 applies the rule that was built in the sub-routine 
BUILD_DYNAMIC_RULE on the entries 60 of the EPG databases 22 to identify m 
EPG database entries 60 that satisfies the rule. This is followed by step 665 which calls 
the sub-routine INTERPRET. Sub-ioutine INTERPRET builds a map of 
recommendations and is shown in Fig. 9D. 

Sub-ioutine PRODUCE is called in step 667 which produces an ordered list of 
viewer recommendations from the map of recommendations. Sub-routine PRODUCE is 
shown in Fig. 9E and starts in step 750. 

Step 672 calculates the recommendations counter r to be the previous count plus 
the number m of recommendations produced by sub-routine PRODUCE called in step 
667. Step 675 determines whether the recommendations counter r is smaller than the 
portion a, of the predetermined desired number R of recommended programs. If the 
determination of step 675 is negative, then a sufficient number of recommendations were 
created for that task and the sub-routine REASON continues to step 682. Alternatively, 
if step 675 determines that not enough recommendations were created, the sub-routme 
REASON continues to step 680 where the hst of ordered recommendations, is joined in a 
ranked set X. This is done by. for each entry firom the ordered hst of recommendations, 
determining whether the entry already exists in the ranked set X. If the entry already 
exists, the entry is ignored and the next entry is considered. However, if the entry does 
not yet exist, then it is entered at the end of the ranked set X. 

Step 677 then determines whether the viewer profile counter J is still smaller than 
the total number of viewer profile entries 503 and if so, directs the sub-routine REASON 
to step 658 where the counter 7 is incremented before directing the sub-routine back to 
step 657. This allows more recommendations to be determined by finding a next viewer 
profile entry 503 that meet the filter criteria. 
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• From step 6l^OT from step 677 when aU the viewer profile entries 503 have been 
considered, the sub-routine REASON returns to the procedure RECOMMEND in step 
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Referring to Fig. 9C wherein the sub-routine BUILD_DYMANIC_RULE is 
shown. Sub-routine BUILD_DYMANIC_RULE builds a dynamic rule for the ordered 
viewer profile entry 503 that satisfied the chosen filter, and starts in step 700. 

Step 702 sets a string Y as the source of the EPG program database 22. The string 
Y, and hence the EPG program database 22 is formulated in a string "tmp" in step 705. 
Steps 707 to 712 set variables day. hours and minutes as the date and time for which 
recommendations should be provided. This date and time were obtained from the DTV 
agent in the SendRecommendationRequest message. The variables day. hours and 
minutes are added to the string "tmp". allowing a 2 hour window around the hours 
variable. 

Step 715 determines whether the intersecting features of the viewer profile entry 
503 were relaxed by perfoiming step 609. The sub-routine BUILD_DYMANIC_RULE 
continues to step 718 if the intersecting features of the viewer profile entry 503 were 
relaxed, where the category of the ordered viewer profile entry 503. if it is not equal to -1 
(don't care), is added to the string «tmp". Similarly, in step 719 the sub-category of the 
ordered viewer profile entry 503 is added to the string "tmp" if it is determined not to be 
equal to -1 (don't care). The sub-routine then proceeds to step 720. 

If step 715 determines that the intersecting features have not been relaxed, then 
step 717 determines whether.all the attributes of the ordered viewer profile entry 503 have 
been processed. If so, then a string "rule" is set to be equal to the string "tmp" in step 720 
before sub-routine BUILD_DYMANIC_RULE returns to the sub-routine REASON in 
step 729. 

However, if there are unprocessed attributes of the ordered viewer profile entry 
503, then steps 722 and 725 gets the next attribute whose value is not -1 (don't care) and 
add that attribute to the string "tmp". The sub-routine continues to step 717. 

Referring now to Fig. 9D wherein the sub-routine INTERPRET is shown. Sub- 
routine INTERPRET builds a map of recommendations from the returned EPG database 
entries 60, and starts in step 730. 



3I9S33US.doc 




33 




• -nae sub-routme KVTERPRET is initialised in ste^32 by setting the map of 
vxewer recon^nendations as empty, and setting a counter c as 1. Step 735 gets the c-th 
entry of the retun^ed EPG database entries 60 and step 737 adds this entry to the map of 
recommendations according to the category of the entry. Tl.e map of recommendations 
' W.11 have as entries rows having the categories, followed by all the returned EPG database 
enmes 60 having a particular category as a feature. Each row would typically have a 
different number of fields. 

step 740 determines whether the variable c is smaller than the total of returned 
EPG database entries 60. or in other words, whether all the returned EPG database entries 
60 have been entered into the map of recommendations. If it is detennined in step 740 
that all the returned EPG database entries 60 have not been added, then the variable c is 
incremented in step 742 and Ae sub-routine INTERPRET continues again to step 735 

However, if step 740 determines that all the returned EPG database entries 60 
have been added to the map of recommendations, then step 745 returns the sub-routine 
INTERPRET to the subroutine REASON. 

Referring to Fig. 9E wherein the sub-routine PRODUCE for producing m viewer 
recommendations is shown. Sub-routine PRODUCE starts in step 750. 

The sub-routine PRODUCE is mitiaUsed in step 752 by setting the vectors of 
recommendations as empty, and setting a counter /i as 1. Step 755 gets the h-th row from 
the recommendations map and step 757 retrieves a first component of the h-th row of the 
recommendations map as the category ID and a second component as all the returned 
EPG database entries 60 (or programs) with that category as a feature. Step 758 adds the 
first and second components together into a vector of categorised recommendations. 

Step 760 determines whether the variable h is smaller than the total number of 
rows in the recommendations map, or in other words, whether all the rows in the 
recommendations map have been converted into vectors. If it is determined in step 760 
that the recommendations map has not been fully converted, then the variable h is 
incremented in step 761 and the sub-routine PRODUCE continues again to step 755. 

However, if step 760 determines that all the rows of the recommendations map 
have been converted, then step 762 returns the sub-routine PRODUCE to the subroutine 
REASON. 
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•When the avS& manager 38 receives the message SetProgramSelect ion 
from the DTV agent 36 (step 13 of Table 2), indicating that the viewer has selected a 
particular program 68. the avatar manager 38 calls routine ON_PROGRAM_SELECT, 
which is shown in Fig. 9F and starts in step 770. Step 775 detennines whether the 
selected program was within the first half of the ranked list of recommendarions X. If this 
determination is found to be true, then a variable mc. which is a Task_Value increment, is 
set to a positive value in step 776. Alternatively, the variable inc is set to a negative value 
in step 777. 

After setting the variable inc in step 776 or step 777. step 782 adds the variable inc 
to the Task_Value of the Gradual Change task selected in step 604 of the 
RECOMMEND procedure. Therefore, if the selected program is in^the upper halve of 
the set of ranked recommendations X. then the viewer recommendation 67 are deemed to 
have been successful, and the Task_Value of the gradual task used by the 
recommendation module 40 is increased, thereby ensuring that it will again be used for 
future recommendations. However, if the selected program was Usted in the lower half of 
the set of ranked recommendations X, the recommendation possibly was not optimal, and 
the Task_Value of the gradual task used by the recommendation module 40 is decreased. 

In an alternative implementation, sub-routine INTERPRET records the Task_ID 
of the task(s) producing each of the recommendations, nils allows the routine 
ON_PROGRAM_SELECT to only adjust the Taak.Value of the task that produced the 
selected recommendation. 

The methods of Figs 7A to 7K; and Fig. 8 or Figs. 9A to 9F, may be practiced 
using a conventional general-purpose computer system 100, such as that shown in Fig. 10 
wherein the processes of Figs 7A to 7K, Fig. 8 and Fig, 9 may be implemented as 
software, such as an apphcation program executing within the computer system 100. In 
particular, the steps may be instructions in the software that are carried out by the 
computer. The software may be stored in a computer readable medium, including the 
storage devices described below. The software is loaded into the computer from the 
computer readable medium, and then executed by the computer. A computer readable 
medium having such software or computer program recorded on it is a computer program 
product. The use of the computer program product in the computer preferably effects an 
advantageous apparatus in accordance with the implementations of the invention. 
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• The computer system 100 comprises a computer module 102, input devices such 
as a keyboard 110 and mouse 112, output devices including a printer 108 and a display 
device 104. 

The computer module 102 typically includes at least one processor unit 114, a 
memory unit 118, for example formed from semiconductor random access memory 
(RAM) and read only memory (ROM), input/output (I/O) interfaces including a video 
interface 122. and an I/O interface 1 16 for the keyboard 110 and mouse 112. A storage 
device 124 is provided and typically includes a hard disk drive 126 and a Hoppy disk 
drive 128. A magnetic tape drive (not illustrated) may also be used. A CD-ROM 
drive 120 is typically provided as a non-volatile source of data. The components 1 14 
to 128 of the computer module 102, typically communicate via an interconnected bus 130 
and in a manner which results in a conventional mode of operation of the computer 
system 100 known to those in the relevant art. Examples of computers on which the 
implementations can be practised include IBM-PC's and compatibles. Sun Sparcstations 
or alike computer systems evolved therefrom. 

Typically, the application program of the preferred implementation is resident on 
the hard disk drive 126 and read and controlled in its execution by the processor 114. 
Intermediate storage of the program may be accompUshed using the semiconductor 
memory 118, possibly in concert with the hard disk drive 126. In some instances, the 
application program may be supplied to the viewer encoded on a CD-ROM or floppy disk 
and read via the corresponding drive 120 or 128. or alternatively may be read by the 
viewer bom a network via a modem device (not illustrated). Still further, the software 
can also be loaded into the computer system 100 from other computer readable medium 
including magnetic tape, a ROM or integrated circuit, a magneto-optical disk, a radio or 
infra-red transmission channel between the computer module 102 and another device, a 
computer readable card such as a PCMCIA card, and the Internet and Intranets including 
email transmissions and information recorded on websites and the like. The foregoing is 
merely exemplary of relevant computer readable mediums. Other computer readable 
mediums may be practiced without departing from the scope and spirit of the invention. 

The methods of Figs 7A to 7K, Fig. 8 and Figs. 9A to 9F may alternatively be 
implemented in dedicated hardware such as one or more integrated circuits performing 
the functions or sub functions of Figs 7 A to 7K. Fig. 8 and Fig. 9 A to 9F. Such dedicated 
hardware may include graphic processors, digital signal processors, or one or more 
microprocessors and associated memories. 
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The foregoing describes only some embodiments of the present invention, and 
modifications and/or changes can be made thereto without departing from the scope and 
spmt of the invention, the embodiment being illustrative and not restrictive 
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